\ 



Europdisches Patentamt 



< 

CO 
O) 

CO 
CO 

Q_ 
LU 



(19) y {W/J European Patent Office 




Office europgen des brevets 


(n) EP 0 864 916 A1 


(12) EUROPEAN PATENT APPLICATION 


(43) Date of publication: 


(51) Int. Cl. s : G03B 19/00, H04N 1/21, 


16.09.1998 Bulletin 1998/38 


G03B 17/24 


(21) Application number: 98200386.5 




(22) Date of filing: 09.02.1998 




(0*17 uesignaiea ooniracriny oiaies. 


f72^ Inventors' 


AT BE CH DE DK ES Fl FR GB GR IE IT LI LU MC 


• Fellegara, Peter, 


NL PT SE 


c/o Eastman Kodak Company 


Designated Extension States: 


Rochester, New York 14650-2201 (US) 


AL LT LV MK RO SI 


• Kutin, Jr., Robert Louis, 




Eastman Kodak Company 


(30) Priority: 20.02.1997 US 803341 


Rochester, New York 14650-2201 (US) 


(71) Applicant: EASTMAN KODAK COMPANY 


(74) Representative: 


Rochester, New York 14650 (US) 


Lewandowsky, Klaus, Dipl.-lng. et al 




Kodak Aktiengesellschaft, 




Patentabteilung 




70323 Stuttgart (DE) 



(54) Hybrid camera with identification matching of film and electronic images 

(57) A hybrid camera that includes imaging mode 
selector (23) for selecting at least one of a f ilm mode of 
operation and a hybrid mode of operation; a removable 
memory interface connection (130) for receiving a 
removable memory device; digital imaging system (16, 
70) for generating a digital image representative of an 
imaged subject scene in each of the film mode and 
hybrid mode of operation; a working memory (124) for 
storing the digital image generated by the digital imag- 
ing means as a working image; a photographic imaging 
system (14, 60) for imaging the subject scene onto a 
photographic film to generate a photographic film image 
corresponding to the digital image in the film mode and 
the hybrid mode of operation; and a control processor 
(68, 72) for generating a film mode digital image and a 
hybrid mode digital image from the working image, 
respectively, in the film mode and hybrid mode of oper- 
ation. A recording mechanism (108) records image data 
related to the corresponding photographic film image on 
the photographic film under control of the control proc- 
essor. Identification data corresponding to the photo- 
graphic film and the corresponding photographic film 
image is stored with at least one of the hybrid mode dig- 
ital image and film mode digital image in the hybrid 
mode of operation and the film mode of operation. The 
identification data is entered either manually via a cam- 
era operator interface (74) or is generated automatically 
by a cartridge identification sensor (107). Alternatively, 
the identification data is encoded on the photographic 
film and the carbide identification sensor reads the iden- 
tification data from the encoded photographic film. 
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Description 

The invention relates in general to hybrid cameras 
that include both a digital imaging system and a photo- 
graphic imaging systems. More specifically, the inven- 
tion relates to a hybrid camera that includes a 
mechanism for identification matching of images stored 
on a photographic film cartridge and images stored on 
an electronic storage medium. 

Several types of hybrid camera structures have 
been proposed that permit a camera operator to capture 
images of a subject scene as either a digital image or a 
photographic image. Still further, cameras have been 
proposed in which the subject scene is imaged essen- 
tially simultaneously, wherein the digital image can be 
used in a preview mode to determine whether the pho- 
tographic image captured the correct scene information. 
In some applications, it is desirable to retain the digital 
image captured with the photographic image on a 
removable storage medium such as a memory card. In 
such cases, it would be desirable to provide a mecha- 
nism for providing identification matching of the images 
stored on the memory card with the images stored on 
film cartridges. 

It is therefore an object of the invention to provide a 
mechanism for identification matching of images stored 
on a memory card with images stored on film car- 
tridges. 

A camera according to the invention includes an 
imaging mode selecting means for selecting at least 
one of a film mode of operation and a hybrid mode of 
operation; a digital imaging means for generating a dig- 
ital image representative of an imaged subject scene in 
each of the film mode and hybrid mode of operation; a 
working memory for storing the digital image generated 
by the digital imaging means as a working image; pho- 
tographic imaging means for imaging the subject scene 
onto a photographic film to generate a photographic film 
image corresponding to the digital image in the film 
mode and the hybrid mode of operation; control 
processing means for generating a film mode digital 
image and a hybrid mode digital image from the working 
image, respectively, in the film mode and hybrid mode of 
operation, wherein the control processing means trans- 
fers the hybrid mode digital image to a non-volatile 
memory and wherein the control processing means 
transfers the f ilm mode digital image to an internal base 
camera memory of the camera in the film mode of oper- 
ation; display means for selectively displaying at least 
one of the film mode digital image and the hybrid mode 
digital image; and recording means for recording data 
related to the corresponding photographic film image on 
the photographic film under control of the control 
processing means. Uniquely in accordance with the 
invention, the camera includes identification means for 
generating identification data corresponding to the pho- 
tographic film or cartridge and the corresponding photo- 
graphic film image and storing the identification data 
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with at least one of the hybrid mode or film mode of 
operation. 

The identification means may include a camera 
operator interface for manually entering the iderrtifica- 
5 tion data, the user preferably being prompted to enter 
the data for each new cartridge; or a cartridge identifica- 
tion sensor means for reading an identification code on 
a film cartridge containing the photographic film, 
wherein the cartridge identification sensor means sup- 
10 plies the identification code to the control processing 
means; or a cartridge identification sensor means for 
reading an identification code encoded on the photo- 
graphic film; or a magnetic read head and wherein the 
recording means comprises a magnetic write head. In 
15 the last embodiment of the identification means, the 
magnetic read head and the magnetic write head may 
be integrally formed. 

The camera may further include a removable mem- 
ory interface connection means for receiving a remova- 
20 ble memory device; wherein the non-volatile memory is 
comprised in a removable memory device; and wherein 
the control processing means transfers the digital mode 
digital image and the hybrid mode digital image to the 
removable memory interface connection means for sub- 
25 sequent storage on the removable memory device. 

Optical sensors also could be used to read car- 
tridge identification data. The cartridge identification 
sensor is preferably provided within the film chamber of 
the camera, so that the identification data is read as the 
30 film cartridge is inserted into or ejected from the cam- 
era. Alternatively, the cartridge identification sensor is 
provided in the main body of the camera to allow the 
camera operator to move the film cartridge past the car- 
tridge identification sensor prior to insertion into the film 
35 chamber. 

Still further, the identification data may be encoded 
on the photographic film and the cartridge identification 
sensor may read the identification data from the 
encoded photographic film. The identification data is 
40 preferably written as a header file on a leader portion of 
the photographic film contained in the cartridge, thereby 
allowing the identification data to be read as the photo- 
graphic film is threaded in preparation for an exposure 
operation. In such a case, the recording mechanism is 
45 preferably provided with a magnetic read/write head so 
that the read/write head of the recording mechanism 
functions as both the recording mechanism to write data 
to the photographic film and the cartridge identification 
sensor to read data from the photographic film. 
so Other advantages and features of the invention will 
become apparent from the following detailed descrip- 
tion of the invention, the appended claims and the draw- 
ings. 

The invention will be described in greater detail 
55 below with reference to the accompanying figures, 
wherein: 

Fig. 1 is a front view of a camera in accordance with 
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the present invention illustrated with a lens cover in 
a closed position; 

Fig. 2 is a front view of the camera of Fig. 1 with the 
lens cover illustrated in an extended position; 
Fig. 3 is a top view of the camera illustrated in Fig. 
1; 

Fig. 4 is a side view of the camera illustrated in Fig. 
2 with the lens cover in the extended position; 
Fig. 5 is a back view of the camera illustrated in Fig. 
1 with the lens cover in the closed position; 
Fig. 6 is a schematic block diagram of the system 
architecture of the camera illustrated in Fig. 1 ; 
Fig. 7 is a block diagram illustrating the functional 
division of a base camera memory illustrated in the 
schematic block diagram of Fig. 6 into a camera 
status storage section, an album image storage 
section, and a film mode image storage section; 
Fig. 8 is an illustration of a user interlace window 
displayed on the main screen display unit illustrated 
in Fig. 5 for selecting a scroll option; 
Fig. 9 is an illustration of a user interface window 
displayed on the main screen display unit illustrated 
in Fig. 5 for selecting a starting image for the scroll- 
ing function illustrated in Fig. 8; 
Fig. 10 is an illustration of a user interface window 
displayed on the main screen display unit illustrated 
in Fig. 5 for selecting a specific image number as a 
starting image for the scrolling function illustrated in 
Fig. 8; 

Fig. 11 is an illustration of a graphical user interface 
displayed on the main screen display unit illustrated 
in Fig. 5 for a title function; 
Fig. 12 is an illustration of a graphical user interface 
displayed on the main screen display unit illustrated 
in Fig. 5 for an image format function; 
Figs. 13 A. B, C and D are illustrations of the a dig- 
ital mode image format, a hybrid or film mode 
HDTV image format, a hybrid or film mode pano- 
ramic image format and a hybrid or film mode clas- 
sic image format; 

Figure 14 is a schematic block diagram illustrating 

an image record for a digital image; 

Fig. 1 5 is an illustration of a graphical user interface 

displayed on the main screen display unit illustrated 

in Fig. 5 for an album function; 

Fig. 16 is an illustration of a graphical user interface 

displayed on the main screen display unit illustrated 

in Fig. 5 for a slide show function; 

Fig. 1 7 is an illustration of a current film order status 

window displayed on the main screen display unit 

illustrated in Fig. 5; 

Fig. 18 is an illustration of a graphical user interface 
displayed on the main screen display unit illustrated 
in Fig. 5 for entering cartridge identification informa- 
tion; 

Fig. 19 is schematic diagram illustrating the con- 
nection of a camera in accordance with the inven- 
tion to a host computer; and 



Fig. 20 is an illustration of a graphical user interface 
displayed on a monitor of the host computer illus- 
trated in Fig. 19 for entering camera commands. 

5 A hybrid camera in accordance with the invention is 

shown in Fig. 1 as including a main camera body 10 on 
which a sliding lens cover 12 is attached. A silver-halide 
optical system 14 and a digital imaging optical system 
16 are located behind the sliding lens cover 12, and are 
10 both exposed to scene light when the sliding lens cover 
12 is extended as illustrated in Fig. 2. An electronic flash 
unit 1 8 is preferably located on a top edge of the sliding 
lens cover 1 2, such that the extension of the lens cover 
12 places the electronic flash unit 18 in a position suffi- 
15 ciently distant from the silver-halide optical system 14 
and the digital imaging optical system 16 to prevent the 
occurrence of "red eye" in photographic and digital 
images captured by the camera. In the illustrated 
embodiment, a separate optical viewfinder 20 is pro- 
20 vided adjacent to the lens cover 12, although it will be 
understood that viewf inders incorporated within or utiliz- 
ing elements of either the silver-halide optical system 14 
and/or the digital imaging optical system 16 may be 
readily employed. The optical viewfinder 20 includes a 
25 masking device, for example a segmented LCD or 
mechanical mask, that is used to match the image 
viewed by a camera operator through the viewfinder 20 
to a corresponding image format selected by the cam- 
era operator. In a preferred embodiment, the optical 
30 viewfinder 20 provides several different aspect ratios 
including: a full VGA aspect ratio corresponding to an 
aspect ratio, such as 4:3, of the digital imaging optical 
system 16; an HDTV aspect ratio corresponding to the 
aspect ratio, such as 7:4, of the silver-halide optical sys- 
35 tern 14; a classic film aspect ratio, such as 10:7; and a 
panoramic aspect ratio, such as 20:7. The HDTV, clas- 
sic and panoramic aspect ratios are the same as those 
used for the Advanced Photo System (APS) cameras 
introduced in 1996. 
40 A top view of the camera body 10 is illustrated in 
Fig. 3. A liquid crystal display (LCD) status unit 22 is 
provided on the top of the main camera body 10 to dis- 
play various camera status data to the camera operator. 
The LCD status unit 22 is roughly partitioned into three 
45 areas: an area for displaying information specific to film 
images; an area for cfisplaying information specific to 
digital images; and a general information area that dis- 
plays information related to both film images and digital 
images. In addition to the status unit 22, various opera- 
50 tor controls are provided on the top of the camera body 
10 including an image capture mode selector switch 23, 
a shutter button 24, a zoom control switch 25, a picture 
taking mode selector switch 26, a flash mode selector 
switch 28. a timer mode selector switch 30, and an 
55 image format selector switch 32. As illustrated, image 
capture mode switch 23 allows for settings of Digital, 
Hybrid or Film. However, those skilled in the art will 
appreciate that many features of the invention would be 
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applicable in cameras where only Digital and Hybrid 
modes are provided, or only Digital and Film, or only 
Hybrid and Film, or only Hybrid. The LCD status unit 22 
is preferably mounted on a hinged support element 34 
that is coupled to the lens cover 12, such that the LCD 
status unit 22 is tilted toward the camera operator when 
the lens cover 12 is extended during an image capture 
operation as shown in Fig. 4. 

A color main screen display unit 36 is provided on 
the back of the main camera body 10, as illustrated in 
Fig. 5, and is preferably recessed from the back surface 
of the main camera body 10 for protection. A main 
screen operator control unit 38 is provided adjacent to 
the main screen display unit 36 and includes an edit 
switch 40, an exit switch 42 and a directional switch unit 
44. The directional switch unit 44 is preferably a four 
directional thumb pad segmented into four different indi- 
vidual directional switches including an up directional 
switch 46, a down directional switch 50, a right direc- 
tional switch 48 and a left directional switch 52. It will be 
understood, however, that other types of directional 
switch units, for example track balls, pressure pads, and 
so forth, may be readily employed to enter directional 
signals. The main screen operator control unit 38 is uti- 
lized in conjunction with elements of graphical user 
interfaces displayed on the main screen display unit 36 
to control various camera functions that will be 
described in greater detail below. 

The main camera body 10 is also provided with a 
memory card door 54, a battery compartment door 56 
and a film chamber door 58 as illustrated in Fig. 5. The 
memory card door 54 is provided to protect a memory 
card interface connector located in the main camera 
body 10. The battery compartment door 56 and film 
chamber door 58 are provided in the bottom of the main 
camera body 10 in a conventional manner to provide 
access to an internal film chamber and a battery com- 
partment. 

The overall system architecture of the hybrid cam- 
era is provided in Fig. 6. The basic system components 
of the system architecture include the silver-halide opti- 
cal system 1 4, the digital imaging optical system 1 6, the 
electronic flash unit 18, the optical viewfinder 20, a film 
transport unit 60, a range finding module 62, a light sen- 
sor 64, a main camera controller 68, an analog subsys- 
tem unit 70, a digital subsystem unit 72, a camera 
operator interface 74, and a power supply unit 76. A 
detailed description of each of the basic system compo- 
nents will be provided below. 

The silver-halide optical system 14 preferably 
includes a multielement lens 78, an aperture/shutter 
mechanism 80, and a zoom/focus mechanism 82. The 
operation of the aperture/shutter mechanism 80 and 
zoom/focus mechanism 82 is controlled in a conven- 
tional manner by the main camera controller 68 to 
adjust focusing and exposure operations of the silver- 
halide optical system 14 in response to various inputs 
including signals received from the range finding mod- 



ule 62, the light sensor 64, the shutter button 24, and 
zoom control switch 25. The silver-halide optical system 
14 is located within the camera body 10 to focus a sub- 
ject image on a film plane 100 of the film transport 60 
5 during both a film image capture mode of operation and 
a hybrid image capture mode of operation as will be 
described in greater detail below. 

The digital imaging optical system 16 includes a 
fixed focus, dual focal length, multi-element lens 84, a 
w blur filter 86, a telephoto drive mechanism 88, and an 
aperture drive mechanism 90. The telephoto drive 
mechanism 88 moves part of the lens 84 to provide mul- 
tiple focal lengths in accordance with instructions 
received from the main camera controller 68. Similarly, 
15 under control of the main camera controller 68, the 
aperture drive mechanism 90 adjusts an aperture 92 of 
the digital optical system 16 to a desired setting. The 
digital imaging optical system 16 is located within the 
camera body 10 to focus a subject image onto an elec- 
20 tronic CCD image sensor 94 provided within the analog 
subsystem unit 70. 

The optical viewfinder 20 is preferably mechanically 
linked to the zoom/focus mechanism 82 of the silver- 
haJide optical system 14 via a mechanical linkage 83, 
25 such that operation of the zoom/focus mechanism 82 
causes a corresponding change in the optical system 
21 of the optical viewfinder 20. The optical viewfinder 
20. as discussed above, includes a masking device 23 
that is utilized to appropriately frame the subject image 
30 for different imaging formats selected by the camera 
operator with the image format selector switch 32. In the 
preferred embodiment, icons located within the view- 
finder 20 indicate various operating modes of the cam- 
era including digital image capture mode, film image 
35 capture mode or hybrid image capture mode. In addi- 
tion, conventional light-emitting-diode (LED) status indi- 
cators are provided within the optical viewfinder 20 to 
inform the camera operator of various camera condi- 
tions while the camera operator is looking through the 
40 viewfinder 20. 

The electronic flash unit 18, the range finding mod- 
ule 62 and the light sensor 64 are of conventional 
design. A Fuji AF-Module FM6224T31 (available from 
Fuji Electric Co., Ltd. of Japan), for example, is prefera- 
45 bly utilized as the range finding module 62 to provide 
subject distance information to the main camera con- 
troller 68. Although the light sensor 64 can be imple- 
mented as a discrete component to provide light level 
data to the main camera controller 68, it is preferable to 
so utilize the CCD image sensor 94 provided in the analog 
subsystem unit 70 to perform the light sensing operation 
in additional to image capture. Individual pixel elements 
or groups of pixel elements within the CCD image sen- 
sor 94, for example, are sampled prior to an exposure 
55 operation to provide light level data to the main camera 
controller 68. thereby eliminating the need for a sepa- 
rate light level sensor. 

The film transport unit 60 includes a conventional 
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film drive 96 that advances photographic film from a film 
cartridge located in a film chamber 98 to the image 
plane 100 of the film transport unit 60, where the photo- 
graphic film is exposed to scene light by the silver-halide 
optical system 14 described above, and then to a wind- 5 
ing spool 102. The film drive 96 also works in reverse in 
a conventional manner to rewind exposed film from the 
winding spool 102 back into the cartridge located in the 
film chamber 98 in response to a rewind signal provided 
either automatically from the main camera controller 68 to 
or by the activation of a rewind switch on the camera 
operator interface 74. Various sensors, including a film 
perforation sensor 104 and cartridge sensors 106, are 
provide within the film transport unit 60 to provide infor- 
mation regarding the presence and type of the film car- 15 
tridge and the advance of the film to the main camera 
control unit 68 in a conventional manner. In addition, at 
least one magnetic head 108 is provided to write data 
supplied from the main camera controller 68 to a mag- 
netic layer provided on the photographic film. For exam- 20 
pie, as in the known film for APS cameras, specific 
areas located adjacent to each photographic image are 
defined as camera magnetic recording tracks and pho- 
tofinisher magnetic recording tracks where data is mag- 
netically recorded on a magnetic layer of the 
photographic film. In some applications, it is also desir- 
able for the magnetic head 1 08 to read data already pro- 
vided on the magnetic layer of the photographic film for 
transfer to the main camera controller 68. 

The analog subsystem unit 70 includes the CCD 
image sensor 94, a vertical clock drive circuit 1 1 0, a hor- 
izontal dock drive circuit 1 12 and support electronics for 
the CCD image sensor 94 including a correlated double 
sample (CDS) circuit 1 14, a programmable gain ampli- 
fier 1 1 6, and an analog-to-digital (A/D) converter 1 18. In 
a preferred embodiment, the CCD image sensor 94 is a 
KAI-0320CM device (manufactured by Eastman Kodak 
Company of Rochester, New York) that includes a 640 x 
480 array of imaging elements with a Bayer color filter 
array. The signal from the CCD image sensor 94 is pro- 
vided to the CDS circuit 114, which takes into account a 
pixel by pixel reference level provided by the CCD 
image sensor 94. The signal output from the CDS circuit 
114 is supplied to the programmable gain stage 116. 
The use of the programmable gain stage 1 16 allows the 
operating range of the system to be extended under low 
light conditions by boosting the signal level received 
from the CCD image sensor 94. The programmable 
gain stage 1 16 is programmed digitally via a serial data 
connection provided to the digital subsystem unit 72. 
The A/D converter 1 1 8 converts the sampled and ampli- 
fied analog signal output from the programmable gain 
stage 116 into a ten bit digital value. The CDS circuit 
114, the programmable gain stage 116. and the A/D 
converter 1 18 are preferably implemented with a Philips 
TDA8786 integrated circuit device. The TDA8786 inte- 
grated circuit device also includes a digital-to-analog 
(D/A) converter (not shown) that is used to control the 



substrate voltage of the CCD image sensor 94, thereby 
eliminating the need for a potentiometer or other adjust- 
ment to provide this function. Accordingly, manufactur- 
ing adjustments for variations in different CCD image 
sensors are greatly simplified. The D/A converter of the 
TDA8786 integrated circuit device is programmed by 
the same serial data connection to the digital subsys- 
tem 72 used to program the programmable gain stage 
114. 

The digital subsystem unit 72 includes a microcon- 
troller 120, an application specific integrated circuit 
(ASIC) 122 that includes various timing and data han- 
dling circuits, a DRAM or non-volatile working memory 
124, a non-volatile base camera flash memory 126, a 
read only memory (ROM) 128, a memory card interface 
connector 130 for receiving a non-volatile memory card, 
LCD interface drive circuitry 132 for driving the main 
screen unit 36, and a standard communications inter- 
face circuit 134 (for example RS232) coupled to a data 
communications port 136 provided on the main camera 
body 1 0. The digital subsystem unit 72 works in cooper- 
ation with the main camera controller 68 to control the 
operation of the various system components. In addi- 
tion, the digital subsystem unit 72 interfaces with a host 
computer to perform various operations when the main 
camera body 10 is coupled to the host computer via the 
data communications port 136. The data communica- 
tions port 136 can either be a hard wire type communi- 
cations port (that is, requiring a physical connection to 
the host computer) or a wireless type communication 
port (for example infrared or RF). 

The microcontroller 120 is preferably implemented 
using a Motorola MPC823 PowerPC based reduced 
instruction set (RISC) microcontroller. In addition to the 
PowerPC core, this device includes a serial data com- 
munications channel for host communication, timers for 
monitoring or controlling the lengths of events, an LCD 
controller for providing image data to the main screen 
display unit 36, and some digital signal processing 
(DSP) capabilities to facilitate processing image data. A 
DRAM controller is also provided by the MPC823 device 
to allow a direct connection to common DRAM type 
memories, and bit addressable input/output ports pro- 
vide for low level control of digital image capture mech- 
anisms, for example, serially programming the Philips 
TDA8786 integrated circuit device in the analog subsys- 
tem unit 70, providing low speed clock signals (line rate 
and frame rate) to the analog subsystem unit 70, and 
sensing synchronization event signals from the main 
camera controller 68 and the timing and data handling 
ASIC 122. 

The timing and data handling ASIC 122 includes 
basic timing and data handling circuits to provide the 
interface between the digital subsystem unit 72 and the 
analog subsystem unit 72 and the analog subsystem 
70, the interface between the MPC823's LCD controller 
and the main screen 36, and the interface between the 
MPC823 and a non-volatile memory card connected to 



30 



35 



40 



45 



50 



5 



BNSDOCID: <EP 086491 6A1J_> 



EP 0 864 916 A1 



10 



the interface connection 130. For example, for the inter- 
face between the analog subsystem unit 70 and the dig- 
ital subsystem unit 72, the ASIC 122 includes an analog 
subsystem timing chain that provides clocks signals for 
the various components of the analog subsystem unit 5 
70 as image data flows from the analog subsystem unit 
70 and into the digital subsystem unit 72. The timing for 
the analog subsystem 70 unit is line based, namely, the 
clocking, conditioning, conversion, and collection of 
image data for the pixels in a line, but additional timing 70 
signals are provided by the microcontroller 120 to begin 
each line, to begin a frame, and to control electronic 
exposure. The data handling circuit of the ASIC 122 col- 
lects the ten bit image data from the analog subsystem 
unit 70, applies a function to the data for the purpose of 75 
compressing the data from ten bits to eight bits (selecta- 
ble between a two bit right shift and a fixed function), 
packs the data into thirty-two bit words, and places the 
data into a small FIFO (32 bits wide by 2 bits deep) prior 
to subsequent transfer to the microcontroller 120. For 20 
the interface to the main screen 36, the ASIC 122 pro- 
vides a timing chain that operates in conjunction with 
the LCD controller of the microcontroller 120 to refresh 
the main display screen unit 36 by providing both line 
rate and frame rate signals. The ASIC 122 operates 25 
autonomously and requires no periodic intervention 
from the microcontroller 120 in order to continuously 
refresh the main display screen unit 36. For the inter- 
face to a non-volatile memory card coupled to the inter- 
face connector 130, the ASIC 122 isolates the memory 30 
card from the bus of the microcontroller 120 and also 
provides control signal timing for accessing the memory 
card. 

As described above, the digital subsystem unit 72 
includes three types of memory: DRAM based working 35 
memory 124, read only memory 128, and EPROM 
based non-volatile flash base camera memory 126 that 
is internally fixed within the camera body 10. The work- 
ing memory 124 is used during image data collection 
and processing, and also serves as a frame buffer for 40 
the main display screen unit 36. The ROM 128 is used 
to store the basic operating instructions for the micro- 
controller 120 of the digital subsystem unit 70. The 
EPROM based non-volatile flash base camera memory 
1 26 is used for storage of album images selected by the 45 
camera operator and film mode images captured during 
the film imaging mode of operation that correspond to 
photographic images. In addition, the flash memory 1 26 
is also utilized to store basic camera status and operat- 
ing data including the various operating modes selected sc 
by the camera operator. Accordingly, as shown in Fig. 7, 
the base camera memory 126 is functionally divided 
into a camera status storage section 123 for storing the 
camera status and operational data, an album image 
storage section 1 25 for storing album images, and a film 5i 
mode image storage section 127 for storing film mode 
digital images. As will be described in greater detail, the 
operator can select certain images for album storage in 



the album storage section 125 of the base camera 
memory 1 26 in addition to storage in a memory card (for 
example a flash memory card or PCMCIA card) coupled 
to the interface connector 130 or capture on photo- 
graphic film. Alternatively, rather than using a removable 
memory card, base memory 126 could include a non- 
volatile memory or storage section for high resolution 
images captured in any mode. 

The main camera controller 68 includes a micro- 
controller 140 that communicates with the digital sub- 
system unit 72, camera operator interlace 74, the light 
sensor 64 and the range finder module 62, in order to 
control the operation of the various system components 
including the silver-halide optical system 14, the digital 
imaging optical system 16, and the film transport 60. In 
addition, the main camera controller 68 includes a mag- 
netics I/O circuit 142 and a motor drive circuit 144 to 
respectively drive the magnetic head 108 of the film 
transport unit 60 and the various motors in the aperture, 
telephoto and focusing mechanisms of the silver-halide 
optical system 14 and the digital imaging optical system 
16. The main camera controller 68 also manages power 
up and power down sequencing, keeps track of calen- 
dar and time, and controls the operation of the elec- 
tronic flash unit 18. 

In a preferred embodiment, a Mitsubishi 38000 
series microcontroller is utilized for the microcontroller 
140 of the main camera controller 68. The Mitsubishi 
38000 series microcontroller includes a built-in LCD 
driver, which can be utilized to drive the LCD status unit 
22, and a low speed A/D converter with several multi- 
plexed inputs. Several of the A/D inputs are used to 
measure the signals from the perforation sensor 104 
and cartridge sensors 1 06 provided in the film transport 
unit 60. The Mitsubishi 38000 series microcontroller 
also has an extremely low power mode with low fre- 
quency operation, which allows the microcontroller to 
wake up periodically to keep track of the time. During 
camera operation, the microcontroller 1 40 can switch to 
high frequency operation for the duration of any events 
requiring additional processing power, and then switch 
back to low frequency to conserve power. If a power on 
event is detected (actuation of the shutter button, open- 
ing of the lens cover, opening and closing the film car- 
tridge door, and so forth), the microcontroller 140 
manages the power up sequencing for other subsys- 
tems by enabling appropriate modules within the power 
supply unit 76. The microcontroller 140 holds the digital 
subsystem microcontroller 120 in reset until its power 
supply from the power supply unit 76 is stable. An asyn- 
chronous serial interface allows the main camera con- 
troller 68 to receive and send commands to and from 
the digital subsystem unit 72. Various operator controls 
discussed above that constitute part of the camera 
operator interface 74 are also sensed by the microcon- 
troller's 140 input lines. 

The camera operator interface 74 includes the vari- 
ous operator controls mentioned above in conjunction 
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with the main screen display unit 36 and LCD status unit 
22. The LCD status unit 22 is a preferably a mono- 
chrome device to reduce power requirements, and 
includes segments for displaying conventional camera 
data including: time and date data; battery condition 
data; film speed data; exposure mode data; flash mode 
data; the presence of a film cartridge; and the number of 
film exposures remaining. In addition, the LCD status 
unit 22 includes a segment that indicates the presence 
of a memory card coupled to the interface connector 
130, and the number of images that can be stored on 
the memory card. The main screen display unit 36 is a 
thin film transistor (TFT) type active matrix LCD availa- 
ble from Sharp, which includes 384 cells per row by 220 
rows in the display, consequently 84,480 bytes of work- 
ing memory are required for the display frame buffer of 
the main screen display unit 36. 

The power supply unit 76 preferably provides power 
to the other subsystems of the camera from four AA 
cells 77 (lithium or alkaline) or a main source of power 
via a power adapter connection 79. A number of power 
modules are provided within the power supply unit 76 
that can be independently controlled by the main cam- 
era controller 68 including: an LCD power module 150; 
an analog subsystem module 152; a main power mod- 
ule 154; an LCD backlight power module 156; a digital 
subsystem power module 158; and a flash charger and 
control module 160. The LCD backlight power module 
156 is adjustable by the main camera controller 68 to 
allow customer brightness adjustment and automatic 
compensation for ambient light level. Power can be 
switched on and off independently for the analog sub- 
system module 152, the digital subsystem module 158, 
and the main power module 154. The flash charger and 
control module 160 charges up a flash capacitor 162 of 
the electronic flash unit 18. A conventional sensing cir- 
cuit provides an indication to the main camera controller 
68 when the capacitor 160 is charged sufficiently to 
allow a picture to be taken. The main camera controller 
68 triggers the flashtube 164 of the flash unit 18 by 
means of a dedicated control line. All of the power mod- 
ules of the power supply unit 76 can be separately ena- 
bled and disabled by the main camera controller 68 in 
order to conserve power. 

The basic function of the above-described hybrid 
camera in three image capture modes of operations will 
now be described in greater detail. The three image 
capture modes of operation include: a digital capture 
mode in which digital mode digital images are captured 
and stored on a memory card coupled to the interface 
connector 130; a film capture mode in which photo- 
graphic images are captured on photographic film and 
film mode digital images are captured and stored in the 
base camera memory 126; and a hybrid capture mode 
in which hybrid mode digital images are captured for 
storage on a memory card and corresponding photo- 
graphic images are captured on photographic film. For 
the purposes of the initial discussion of the three image 



capture modes, it will be assumed that: a film cartridge 
has been loaded in the film transport unit 60; a memory 
card has been connected to the interface connector 130 
of the digital subsystem 72; and the camera is in a 

5 power down mode in which the main camera controller 
68 is waiting for an initialization event. 

The main camera controller 68 waits for an initiali- 
zation event in a power down mode to conserve energy. 
The initialization event may include, for example, the 

10 movement of the lens cover 1 2 to the extended position, 
which in turn activates a switch that supplies a corre- 
sponding signal to the main camera controller 68 to 
power-up. In response to the initialization event, the 
main camera controller 68 enters a power up mode and 

15 activates various power modules in the power supply 
unit 76 to power up the corresponding components of 
the camera. It should be noted that the analog subsys- 
tem unit 70 and electronic subsystem unit 72 are pow- 
ered-up regardless of the type of image capture mode 

20 selected, as a full resolution and full size digital working 
image is generated and stored in the working memory 
1 24 in each image capture mode. As will be explained in 
greater detail, however, the processing of the working 
image varies based on the type of image capture mode 

25 selected. The main camera controller 68 activates the 
LCD status unit 22 to display the camera status informa- 
tion stored in the flash memory 126, and sets the digital 
optical system 16, silver-halide optical system 14 and 
viewfinder 20 to the last image format previously 

30 selected or alternatively a default format. 

At this point, the operator can initiate an exposure 
operation by activating the shutter button 24. Alterna- 
tively, the operator may choose to change either the 
image format or the image capture mode by operating 

35 the image format selector switch 30 and the image cap- 
ture mode selector switch 23 accordingly. If the image 
format mode is changed, the main camera controller 68 
controls the viewfinder 20 to select the appropriate 
mask that corresponds to the selected image format 

40 setting corresponding to the new image format. The 
operator may also choose to use the zoom control 
switch 25 to adjust the lens of the silver halide optical 
system 14 and the digital optical system 16. The main 
camera controller 68 controls the operation of the 

45 zoom/focus mechanism 82 and the telephoto mecha- 
nism 88 in response to signals received from the zoom 
control switch 25. At the same time, the optical system 
21 of the optical viewfinder 20 is adjusted via the 
mechanical linkage 83 coupled to the zoom/focus 

so mechanism 82. If the operator does not proceed with an 
exposure operation or the activation of some other cam- 
era function within a predetermined time period, the 
main camera controller 68 deactivates the LCD status 
unit 22 and controls the power supply unit 76 to once 

55 again power down the camera to conserve energy. 

As stated above, a digital working image is cap- 
tured in all three image capture modes of operation that 
corresponds to an image resolution and has an image 
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size corresponding to an aspect ratio of the CCD image 
sensor 94. The resolution of a digital image subse- 
quently stored or displayed, however, is varied based on 
the type of image capture mode selected. In the digital 
image capture mode, a full resolution digital mode 
image is stored without cropping in a memory card cou- 
pled to the interface connector 130. See Fig. 13A, lor 
example. In the film image capture mode, where the dig- 
ital image will only be utilized for display on the main 
screen display unit 36 to show the operator what was 
captured on film, a film mode image of a lower resolu- 
tion is prepared by electronically cropping and interpo- 
lating the full resolution digital image to respectively 
correspond to the resolution of the main screen display 
unit 36 and to the aspect ratio of the photographic film 
images, and is stored in the base camera memory 126. 
See Figs. 13B-D, for example. In the hybrid image cap- 
ture mode, where it is desirable to match the image size 
of the digital image to the aspect ratio of the image to be 
captured on photographic film but retain a high resolu- 
tion digital image, the digital image is electronically 
cropped to create a hybrid mode image which is stored 
in a memory card coupled to the interface connector 30. 
See also Figs. 13B-D. Accordingly, a film mode image 
and a hybrid mode image are essentially cropped ver- 
sions of the digital mode image with respectively differ- 
ent and equal resolutions. 

Prior to exposure in any digital image capture 
mode, the main camera controller 68 initiates preexpo- 
sure operations, such as autofocusing and exposure 
control operations to determine subject distance and 
exposure conditions, in order to properly set the aper- 
tures and lenses of the silver-halide optical system 14 
and the digital imaging optical 16 system and to deter- 
mine if flash is required. In a preferred embodiment, the 
shutter button 24 is a two position switch. When the 
shutter button 24 is pressed to the first position, a signal 
is sent to the main camera controller 68 to perform the 
necessary pre-exposure operations. If the camera is in 
the power down mode, the movement ol the shutter but- 
ton 24 to the first position also causes the main camera 
controller 68 to initiate the power up mode prior to per- 
forming the pre-exposure operation. When the shutter 
button 24 is pressed to the second position, an expo- 
sure signal is sent to the main camera controller 68 to 
initiate an exposure operation. 

When an exposure operation is initiated in the dig- 
ital image capture mode, the main camera controller 68 
informs the digital subsystem unit 72 that a full resolu- 
tion and full size digital mode image is to be captured 
and stored in a memory card coupled to the interface 
connector 130. The microcontroller 120 of the digital 
subsystem unit 72 sends the necessary control signals 
to the analog subsystem unit 70 to initiate image cap- 
ture with the CCD image sensor 94, to process the ana- 
log image signals from the CCD image sensor 94 with 
the CDS circuit 114, the programmable gain amplifier 
1 1 6. and the A/D converter 1 1 8, and to supply a full res- 



olution and full size digital working image to the working 
memory 124 of the digital subsystem 72. The full reso- 
lution and full size digital working image is then trans- 
ferred to the interface connector 130 by the 
5 microcontroller 1 20 for subsequent storage in the mem- 
ory card as a digital mode image. 

When an exposure operation is initiated in the film 
capture mode, a full resolution and full size digital work- 
ing image is again supplied from the analog subsystem 
10 unit 72 to the working memory 1 24 of the digital subsys- 
tem unit 70. At the same time, the aperture/shutter 
mechanism 80 of the silver-halide optical system 14 is 
activated by the main camera controller 68 so that 
scene light is supplied to the image plane 1 00 of the film 
15 transport unit 60. Accordingly, a photographic film 
image is captured that corresponds to the digital work- 
ing image stored in the working memory 124. In the 
case of the film capture mode, however, the digital 
image will be utilized primarily for display purposes to 
20 enable the camera operator to verify what was captured 
on the corresponding photographic film image. How- 
ever, by using main control unit 38 to enter an editing 
mode and using the display of Fig. 15, the last captured 
digital image may still be stored in the memory card. To 
25 store a film image for display, the microcontroller 120 of 
the digital subsystem unit 72 generates and transfers a 
lower resolution representation of the full resolution dig- 
ital working image as a film mode image in a film image 
storage section of the flash memory 126. In addition. 
30 the working image is cropped in size so that the film 
mode image corresponds to the aspect ratio of the cor- 
responding photographic film image, as the film mode 
image need only contain the same scene information as 
the corresponding photographic film image. The reduc- 
35 tion of the resolution and size of the film mode image 
permits the size of the film image storage section in the 
flash memory 126 to be minimized. As the flash mem- 
ory 126 is integrated and internal to the camera struc- 
ture, it is preferable to minimize the amount of memory 
40 required for the flash memory 1 26 in order to reduce the 
expense and size of the overall camera. Accordingly, 
standard image compression techniques, for example 
JPEG, are preferably utilized to compress the film mode 
image prior to storage. The film mode image is prefera- 
45 bly tagged with identification data (ID data) the indicates 
the film frame number of the corresponding film image, 
so the film mode images stored in the film mode image 
storage section 127 can be properly matched to their 
corresponding photographic film images when dis- 
50 played on the main screen display unit 36 in response to 
a display signal supplied to the microcontroller 120 from 
the camera operator interface 74. 

In the hybrid image capture mode, a full size work- 
ing image is again captured with a corresponding pho- 
55 tographic film image and supplied to the working 
memory 124 of the digital subsystem 70. As in a film 
mode capture operation, the microcontroller 120 does 
not transfer the complete digital image, but generates 
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and transfers a reduced sized digital image to the inter- 
face connector 130 for storage in the memory card as a 
hybrid mode image. The reduced sized hybrid mode 
digital image, as with the film mode image, has an 
aspect ratio that corresponds to the aspect ratio of the 
corresponding photographic film image, but maintains 
the same resolution as the working image stored in the 
working memory 124. The effective cropping of the size 
of the working image to match the aspect ratio of the 
corresponding photographic image allows for a reduc- 
tion in the amount of memory required to store a hybrid 
mode image as compared with a digital mode image. 
Accordingly, a greater number of hybrid mode images 
can be stored on the memory card as compared with 
digital mode images. In the case of either hybrid mode 
images or digital mode images, it is further preferable to 
have the microcontroller 1 20 compress the images prior 
to storage as with the film mode images. Although a 
loss of information results from the cropping of the work- 
ing images when storing a hybrid mode image, the 
image information removed to produce the hybrid mode 
image is not required, as the hybrid mode image con- 
tains the same image information as the corresponding 
photographic image. If the camera operator wishes to 
retain all image information, then a digital mode image 
should be captured instead of a hybrid mode image in 
the illustrated embodiment. 

In a preferred embodiment, the last captured work- 
ing image remains in the working memory 124 until a 
new exposure operation is initiated regardless of the 
image capture mode selected, and regardless of 
whether the film cartridge is removed from the film 
chamber 98 or the memory card is removed from the 
interface connector 130. A quick review switch 37, illus- 
trated in Fig. 5, is provided on the back of the camera 
body 10. At any time after the capture of an image and 
before capture of a next image, the review switch 37 can 
be activated by the camera operator to display the last 
captured working image on the main screen display unit 
36 as a review image. The last captured working image 
thus can be displayed without requiring the availability 
of the non-volatile memory of the memory card. Activa- 
tion of the review switch 37 provides a signal to the 
microcontroller 120 to initiate the transfer of the working 
image stored in the working memory 124 to the LCD 
drive circuit 132 for subsequent display on the main 
screen display unit 36 as a review image. It should be 
noted that during the exposure operation described 
above, the main screen display unit 36 is not activated 
unless specifically turned on by the camera operator. 
Accordingly, when the review switch 37 is activated, the 
microcontroller 120 activates the main screen display 
unit 36 to display the review image, either for a predeter- 
mined period of time or until the review switch 37 is 
deactivated, and then deactivates the main screen dis- 
play unit 36 to enter the power conservation mode. 

In contrast to the last working image, the film mode 
images stored in the film mode image storage section 



127 of the flash memory 126 are preferably erased by 
the microcontroller 120 when the film is rewound into 
the cartridge. The size of the film mode image storage 
section 127 of the flash memory 126 need therefore 

s only be sufficient to store a number of film mode images 
corresponding to the maximum number of film images 
that could be captured on one film cartridge. As stated 
above, it is desirable to limit the size of the film mode 
image storage section 127 to reduce the expense and 

10 size of the camera. Accordingly, in the preferred embod- 
iment, digital images corresponding to images captured 
on photographic film are only retained in the hybrid 
image capture mode unless selected for album storage 
as will be described in greater detail. 

75 The camera operator can initiate a review of all dig- 
ital images stored in either a memory card or the base 
camera memory 126 by activating the main screen dis- 
play unit operation switch 39, thereby sending a display 
signal to the microcontroller 120. Review of film mode 

20 images corresponding to images captured on film is 
accomplished by setting the main screen display unit 
operation switch 39 to the illustrated T n or "FILM" set- 
ting. In response, the microcontroller 120 retrieves the 
digital film mode image stored in the film mode image 

25 storage section 127 of the base camera memory 126 
corresponding to the last photographic film image taken 
and displays the image on the main screen display unit 
36. The camera operator can then manually scroll 
through digital film mode images in forward and reverse 

30 directions by utilizing the right directional switch 48 of 
the main screen operator control unit 38 or the left direc- 
tional switch 52. Similarly, digital images stored in either 
the digital image capture mode or hybrid image capture 
mode can be displayed and scrolled by utilizing the 

35 same directional switches and setting the operation 
switch 39 to the illustrated "D" or "DIGITAL" setting. In 
addition, instead of starting at the last image stored in 
either the base camera memory 126 or the memory 
card, a menu option window can be displayed on the 

40 main screen display unit 36 to allow the operator to 
select a specific image as the first image to be dis- 
played. 

Still further, instead of requiring the operator to 
enter a manual command to scroll through each image, 

45 a "slide show" option is preferably provided to allow the 
automatic scrolling of images after either predetermined 
time periods or time periods selected by the operator. 
For example, upon setting the operation switch 39 to a 
selected setting, the microcontroller 120 of the digital 

so subsystem 72 sends a scroll option window to the main 
screen display unit 36 for display. The scroll option win- 
dow includes a "Manual Scroll" icon and an "Slide 
Show" icon as illustrated in Fig. 8. The camera operator 
utilizes the main screen operator control unit 38 to enter 

55 control signals to the microcontroller 120 to select the 
desired scroll option. The microcontroller 120 sends an 
image selection list to the main screen display 36 for 
operator selection that includes a "Last Image 
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Recorded" icon and a "Selected Image" icon as shown 
in Fig. 9. If the "Last Image Recorded" icon is selected 
by the operator, the microcontroller 120 controls the 
transfer and display of the stored digital images in either 
manual or automatic scrolling modes starting with the 
last image recorded and then decrements. If the 
"Selected Image" icon is selected by the operator, the 
microcontroller 120 controls the display unit 36 to dis- 
play a selected image list as illustrated in Fig. 10. The 
operator can then scroll through the numeric list and 
select the desired starting image using the main screen 
operator control unit 38. Alternatively, different user 
interfaces can be employed, for example scrolling num- 
bers or the display of a virtual keyboard on the display 
unit 36, to allow the operator to select a specific image 
as the start image. Still further, a small keyboard or key- 
pad can be incorporated in the camera as part of the 
camera operator interface 74. If the automatic scroll 
mode is selected, a further user interface window (not 
shown) is displayed on the main display screen 36 to 
allow the operator to select a desired time period 
between images or a default time period previously 
stored in memory. 

In addition to scrolling through the stored images, a 
more advanced graphical user interface can be incorpo- 
rated to permit the operator to select various camera 
functions. For example, as shown in Fig. 1 1 , camera 
function icons are displayed in an icon group 200 on the 
main screen display unit 36 to edit information related to 
the images (including conventional APS data), obtain 
help information, enter user defined data into the cam- 
era or perform other functions. An image display area 
202 is used to display the digital image being reviewed 
or edited the display area 202 to indicate the respective 
position of the displayed digital image in its associated 
memory. A function name display area 206 displays the 
camera function currently selected. A function data 
entry area 208 displays data associated with the 
selected camera function. If desired, the icon group 200 
can be generated as transparent icons that can be laid 
over the displayed digital image, so that the size of the 
image display area 202 can be expanded and the cam- 
era operator can see the displayed digital image 
through the displayed icons. 

Each camera function selectable by the camera 
operator has a corresponding individual icon in the icon 
group 200. In the illustrated example, a copy number 
function is accessed by selecting a copy number icon 
210, an image format function is accessed by selecting 
an image format icon 21 2, a title function is accessed by 
selecting a title icon 214, an album function is accessed 
by selecting an album icon 216, and a magnifying func- 
tion is accessed by selecting a magnification icon 218. 
The camera operator activates the edit switch 40 to 
cause the first function icon displayed in the icon group 
200, in this case the copy number icon 210, on the main 
screen display unit 36 to be highlighted. The up direc- 
tional switch 46 and the down direction switch 50 are uti- 



lized to advance through the displayed function icons 
until the desired title icon 208 is highlighted. For exam- 
ple, by activating the down direction switch 50 twice, the 
highlighted icon sequentially moves from the copy 
5 number icon 21 0 to the image format icon 212 and then 
to the title icon 214. Once the desired function icon is 
highlighted, for example the title icon 214, the operator 
presses the edit switch 40 to enter the highlighted func- 
tion mode. The name of the function mode is displayed 
70 in the function name display area 206 of the main 
screen display unit 36 and the current data for the 
selected image is displayed in the function data entry 
area 208. In the case of titles, the up directional switch 
46 and the down directional switch 50 are utilized to 
75 scroll through pre-programmed titles. Alternatively, the 
operator can enter a desired title by scrolling through 
and selecting individual characters displayed in the 
function data entry area 208. A function is exited by 
pressing the exit switch 42. 
20 In a preferred embodiment, if the operator changes 
the title of one digital image and then uses the direc- 
tional switches to selected another digital image without 
exiting the title function, the title selected for the previ- 
ous digital image will be automatically selected for the 
25 newly selected digital image. The title will continue to be 
maintained for all digital images viewed in the title func- 
tion mode until the camera operator either exits the 
function or selects a new title. Accordingly, the camera 
operator can modify a sequence of images to have the 
30 same title in a quick and convenient manner. 

The camera operator can change the image format 
of the displayed hybrid or film mode image by selecting 
the image format function icon 212 to enter the image 
format function as illustrated in Fig. 12. The operator 
35 can select image formats including classic, HDTV and 
panoramic formats associated with conventional APS 
cameras. Film mode images and hybrid mode images 
are stored and displayed on the main screen display 36 
in a 9:16 aspect ratio corresponding to the aspect ratio 
40 oi the silver-halide image system 14, and digital mode 
images are stored and displayed in a 3:4 aspect ratio 
corresponding to the aspect ratio of the CCD image 
sensor 94. The image format selected by the operator 
before the image was captured is displayed in the func- 
45 tion data entry area 208. The operator then uses the 
main screen operator control unit 38 to edit the image 
format selection. In a preferred embodiment, the full 
available digital image for a given image capture mode 
is displayed and a mask 220 may be used to incficate to 
so the operator which portions of the image will be 
excluded for a given selected digital image, when an 
eventual photographic print is made from the corre- 
sponding film image. Fig. 12, for example, illustrates a 
digital mode image that is being displayed in HDTV for- 
55 mat. Accordingly, the operator can change an image for- 
mat, for example from classic format to a panoramic 
format, and compare the differences between the two 
formats before making a final decision as to which for- 
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mat is desired for the selected image. Fig. 13A illus- 
trates an uncropped digital format. Figs. 13B, C and D 
illustrate the same digital format cropped, respectively, 
to the film or hybrid HDTV format, the film or hybrid pan- 
oramic format, and the film or hybrid classic format. 

The film mode images, hybrid mode images and 
digital mode images are stored as image records that 
include an ID file, an image information file (IIF) and an 
image data field (IDF) as illustrated in Fig. 14. The ID file 
contains data identifying the images and includes, for 
example, the frame number tag of a corresponding pho- 
tographic film image in the case of film mode images 
and hybrid mode images. The IIF contains image data 
related to the images and includes, for example, con- 
ventional APS data in addition to other data associated 
with the image that can be entered by the camera oper- 
ator through the camera operator interface 74 or down- 
loaded via the data communications port 136. The IDF 
contains the actual pixel data for the digital image. 
When an editing operation is performed, the IIF for the 
corresponding digital image is updated with the edited 
data by the microcontroller 120. Further, in the cased 
mode images, the operator edited data is also written 
back to the magnetic recording tracks of the corre- 
sponding photographic film image. Accordingly, 
changes selected by the operator, as with data written 
to the film during the image capture operation, can be 
transmitted to a photo finisher with the exposed photo- 
graphic film. 

Data is conventionally written to the magnetic 
recording tracks of the photographic film by the mag- 
netic head 108 after an exposure operation is com- 
pleted and the film is advanced from one frame to the 
next frame by the film transport unit 60. Accordingly, 
when editing information has been entered with respect 
to film mode images or hybrid mode images, the photo- 
graphic film is rewound and advanced once again by the 
film transport unit 60 so that the edited data can be writ- 
ten to photographic film by the magnetic head 108. 
Alternatively, the editing information can be written to 
the photographic film during a rewind operation prior to 
removing a film cartridge from the camera. In this man- 
ner, it is possible to edit data written to the photographic 
film at any time, either prior to the removal of the film 
cartridge 98 or even after re-insertion of a film cartridge 
into the film chamber 98. 

If the camera operator would like to save a particu- 
lar image for future review, even after a film cartridge or 
memory card is removed, the camera operator can 
select the album function icon 216 in the function icon 
group as illustrated in Fig. 15. When the album function 
216 is selected, the digital image displayed on the main 
screen display unit 36 can be selectively stored as an 
album image in the album image storage section 125 of 
the base camera memory 126 by using the directional 
switches to select either a "Yes" or "No" album copy 
option. A stored album image remains in the base cam- 
era memory 126 until specifically deleted by the camera 



operator. Accordingly, the camera includes an inte- 
grated album of stored images that remains with the 
camera. If desired, the album image storage section 
125 of the non-volatile flash memory 126 can be further 

5 sub-divided into different album storage sub-sections 
(125a, 125b, 125c, 125d, and so forth, as shown in Fig. 
7), so that the camera operator can store related 
images (for example related by subject, date or time) in 
the same album sub-section or different camera opera- 
te tors can utilize different album sub-sections to store 
their respective images. In the event of different camera 
operators, password protections are preferably utilized 
so that deletion and/or viewing of images can be per- 
formed only by the operator that stored the images. 

is Album images, as with film mode images, have a 
resolution corresponding to the resolution of the main 
screen display unit 36. The size of the album image 
preferably corresponds to the size of the underlying dig- 
ital image selected for album storage. For example, if a 

20 film mode image or a hybrid mode image is selected for 
album storage, the size of the album image will corre- 
spond to the image size of the hybrid mode image. 
Alternatively, if a digital mode image is selected from 
album storage, the size of the album image will corre- 

25 spond to the image size of the digital mode image. 

The images stored in the album may be accessed 
by setting display unit operation switch 39 to the U A" or 
"ALBUM" position shown in Figure 5. An image in the 
album will be displayed on main display unit 36. The 

30 directional switches 48, 52 may then be used to scroll 
up or down and change the image displayed. The edit 
switch 40 may be used to display the screen of Figure 
16 and the slide show feature discussed above can also 
be utilized to display the album images. Fig. 16, for 

35 example, illustrates a slide show icon 222 that, when 
selected, allows the camera operator to activate the 
slide show feature. While in the slide show function, the 
up directional switch 46 and the down directional switch 
50 are used to control the speed at which images are 

40 presented or a default speed can be utilized. In a pre- 
ferred embodiment, the microcontroller 120 will control 
the display of each album image once when the camera 
is powered by batteries 77 and then exit the function to 
conserve energy. When the camera is connected to a 

45 main power source via the power adapter connector 79, 
the microcontroller 120 will control the display of the 
album images so that they continue to scroll through 
until the operator activates the exit switch 42. A delete 
icon 228 may be used to remove images from the 

so album. 

Other functions include a magnifying function that 
allows the operator to temporarily magnify the image of 
the main display screen 36 when the magnification icon 
218 is selected, a utilities function that allows the oper- 
55 ator to enter time and date information when the utilities 
icon 224 is selected, a help function that the operator 
can access to obtain information from a help menu 
when the help icon 226 is selected, and a print copy 
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function that can be accessed by clicking on the print 
copy icon 210. By entering the number of print copy 
function, the camera operator can select the number of 
prints desired from a photographic film image corre- 
sponding to either a film mode digital image or a hybrid 
mode digital image. The number of prints data is then 
written to the corresponding photographic film image by 
the magnetic head 108. Similarly, an image processing 
function is preferably incorporated that permits the 
operator to crop and pan images, where the image 
processing data is written to the photographic film for 
subsequently retrieval and use by a photo finisher. 

In order to offer the operator the opportunity to edit 
image information prior to removal of a film cartridge 
from the film chamber 98, it is preferable not to have the 
film automatically rewind after the completion of a roll. 
Instead, an indicator is provided, for example an LED 
indicator in the viewf inder, informing the camera opera- 
tor that the end of roll has been reached. At this point, 
the camera operator can press a rewind switch to insti- 
tute film rewinding if editing of image information is not 
desired. If editing is desired, however, the camera oper- 
ator turns on the main display unit 36 the microcontroller 
1 20 causes a current film order window of the type illus- 
trated in Fig. 17 to be display indicating the type of 
images captured. The camera operator can then acti- 
vate the edit switch 40 to cause the camera to go into 
the modes described above or activate the exit switch 
42 to cause film rewinding. 

It is desirable to provide a mechanism for identifying 
the hybrid mode images stored on the memory card 
with the film cartridge containing the corresponding film 
images. In one embodiment, the detection of the inser- 
tion of a film cartridge by the cartridge sensors 106 
causes the microcontroller 120 to display a film car- 
tridge identification prompts illustrated in Fig. 18. The 
camera operator then utilizes the main screen operator 
control unit 38 to scroll through alphanumeric charac- 
ters until a desired character is highlighted. The camera 
operator then presses the edit switch 40 to select the 
highlighted character which is then displayed in a ID dis- 
play area 230. The camera operator continues to select 
characters until the exit switch 42 is pressed to exit the 
function. The user is prompted to enter a roll identifica- 
tion code each time a film cartridge is inserted into the 
film chamber 98. The microcontroller 120 then tags 
each film mode image and hybrid mode image with the 
roll identification code and frame number for each corre- 
sponding photographic image as part of the ID file. 

Alternatively, an automatic mechanism for providing 
roll identification can be incorporated into the camera. 
For example, the cartridge sensors 106 include a car- 
tridge identification sensor 107 that reads an optically 
encoded or magnetically encoded roll or cartridge iden- 
tification code provided on a film cartridge, and supplies 
the identification code to the main camera controller 68 
for transfer to the microcontroller 120. The microcontrol- 
ler 120 can therefore automatically tag each digital 



image, whether a film mode image or hybrid mode 
image, with the corresponding film cartridge ID. 
Although it is preferable to include the cartridge identifi- 
cation sensor 107 within the film chamber 98, it is also 

5 possible to provide the cartridge identification sensor 
1 07 in the main body 1 0 of the camera in a manner per- 
mitting the camera operator to pass a film cartridge over 
the cartridge identification sensor 107 prior to inserting 
it into the film chamber 98. Also, the CCD array 94 could 

10 be used to image an identification code on a cartridge 
held before the camera, after which controller 1 20 would 
process the image of the cartridge to extract the code. 
Still further, the main body 10 can be provided with a 
detachable "wand" with the cartridge identification sen- 

75 sor 107 located on the end of the wand, thereby allow- 
ing the camera operator to scan the film cartridge with 
the wand to enter the cartridge identification data. In 
addition, roll or cartridge identification code can be pro- 
vided on the magnetic layer of the photographic film, 

20 such as in the form of a header file on the leader portion 
of the film. The magnetic head 108 is then used to read 
the header file and transfer the roll identification code to 
the main camera controller 74 and subsequently the 
microcontroller 120. The microcontroller 102 then 

25 stores the roll identification code as part of the ID file for 
a hybrid mode image or a film mode image. 

In a preferred embodiment, only those hybrid mode 
images corresponding photographic film images 
located on the film cartridge presently retained within 

30 the camera are displayed during a scrolling, review or 
editing operation, thereby preventing the camera opera- 
tor from editing information related to a hybrid mode 
image when the editing information cannot be stored on 
the corresponding photographic film image. Alterna- 

35 tively, the camera operator may be permitted to scroll 
through all of the hybrid mode images stored on the 
memory card. In the event, however, that the camera 
operator attempts to edit a hybrid mode image that does 
not have a corresponding photographic film image on 

40 the presently retained film cartridge, a warning indica- 
tion is displayed on the main display screen unit 36 
advising the operator to insert the correct film cartridge. 
Once the correct film cartridge is inserted, the camera 
operator is permitted to edit the information and the 

45 information is updated on the magnetic recording tracks 
of the corresponding photographic film image. 

In a further embodiment, instead of writing a car- 
tridge identification code on the hybrid mode image, a 
memory card identification code can be written to a film 

so cartridge or the magnetic recording tracks of each cor- 
responding photographic film image. In such a case, the 
microcontroller 120 keeps an identification table that 
indicates which film exposure corresponds to a given 
hybrid mode image. For example, when a film cartridge 

55 is removed, the information contained in the table is 
written to the photographic film, preferably in the form of 
a header file at the leader portion of the photographic 
film. Accordingly, when a memory card is inserted into 
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the camera and the editing mode is selected to edit 
hybrid mode images, the microcontroller 120 can iden- 
tify whether the film cartridge presently in the camera 
would contain images corresponding to the hybrid mode 
image desired to be edited. If not, the operator is noti- 5 
tied and prompted to change the film cartridge. When a 
new cartridge is entered the identification table is 
updated with the information corresponding to that par- 
ticular cartridge. It would be apparent to those of ordi- 
nary skill in the art that other addressing schemes can 70 
be employed to provide identification tags for corre- 
sponding rolls and memory card. 

As illustrated in Fig. 1 9, the camera body 1 0 can be 
connected to a host computer 232 via data communica- 
tion port 1 36. When tethered to the host computer 232, 15 
all operator inputs usually selected by the various 
switches provided by the camera operator interface 74 
can be sent to the camera by the host computer 232. 
Accordingly, the camera can be operated remotely by a 
local operator working on the host computer 232 or a 20 
remote operator working on a remote computer 234 
linked to the host computer 232 by any form of commu- 
nication link 233. In one embodiment, a graphical user 
interface is displayed on a monitor 236 of the host com- 
puter 232 (or the remote computer 234) including virtual 25 
switches representing each of the actual control 
switches of the camera as illustrated in Fig. 20. Utilizing 
an interface device such as a "mouse", the operator can 
"click" on any of the virtual control switches to activate 
the corresponding function in the camera as if the actual 30 
button or switch on the camera were being depressed. 

As it may be desirable to have the computer opera- 
tor remain at the computer instead of using the view- 
finder 20 to frame a subject image, a virtual viewfinder 
is provided by utilizing the CCD image sensor 94 to 35 
image the subject scene, either in a still image mode or 
a motion image mode, and supply a digital viewfinder 
image 238 to the computer monitor 236 for viewfinding 
purposes. For example, a working image is captured 
every second and supplied from the working memory 40 
124 to the host computer 232 via the data communica- 
tion port 136 under control of the microcontroller 120. 
When the subject image is appropriate, the computer 
operator then activates the virtual shutter button dis- 
played on the computer monitor 236 to cause image 45 
capture. 

The computer operator can perform a variety of 
image processing functions on digital images down- 
loaded from the camera. For example, image process- 
ing software can be utilized in the host computer 232 to so 
perform zoom, pan and crop functions on any portion of 
a displayed image, attach special borders for special 
occasions, and print the edited images on a printer. 
Image data generated by the host computer 232 can be 
transferred back to the camera to update the image 55 
information files of film mode images stored in the base 
camera memory 126 or of hybrid mode and digital mode 
images contained in a memory card coupled to the 



interface connector 130. In addition, data generated by 
the host computer can be transferred to the camera for 
writing on the magnetic layer of the photographic film by 
the magnetic head 108. Accordingly, a computer opera- 
tor can generate photo-finishing data on the host com- 
puter 232 and transfer the photo-finishing data directly 
to the photographic film in the camera, such that when 
the film is presented to a photo-finisher, the data can be 
retrieved from the photographic film and utilized in a 
photo- finishing operation. Still further, album images 
contained in the host computer 232 can be transferred 
to the camera for storage in the album image storage 
section 125 of the base camera memory 126. 

The utilization of the host computer 232 to perform 
editing operations provides the advantage of having 
more advanced processing power available to perform 
the editing operations and a larger monitor making it 
easier to view the edited images. However, the same 
editing functions can be included within the functions 
available to the camera operator. The camera operator 
can therefore perform image processing functions 
including zooming, cropping and panning utilize the 
camera control interface 74 in conjunction with a user 
interface displayed on the main display screen unit 36. 
Similarly, data corresponding to the editing operation is 
stored on the photographic film by writing the editing 
data to the film with the magnetic head 1 08. 

The camera structure described above provides a 
number of distinct technical advantages. The provision 
of the album image storage section 125 in the internal 
base camera memory 126 provides a convenient and 
practical method of allowing the camera operator to 
store digital images that can be easily transported and 
displayed. The provision of the quick review switch 37 
enables an camera operator to quickly review the last 
image captured, while at the same time conserving 
energy by allowing the main display screen 36 to remain 
deactivated until specifically required for the quick 
review. The provision of the data communication port 
allows the camera to be conveniently coupled to the 
host computer 232. thereby allowing the host computer 
232 to control the operation of the camera. In addition, 
the host computer 232 can transfer data, including 
album images, directly for storage in the main camera 
memory 126 or a memory card coupled to the interface 
connector 130. and also transfer data to photographic 
film contained in the camera by writing the data to the 
photographic film with the magnetic head 108. Still fur- 
ther, the camera operator interface 74 in operation with 
the main display screen unit 36 provides a convenient 
method of entering cartridge identification data into the 
camera, thereby allowing hybrid mode images stored on 
a memory card to be tagged with the cartridge identifi- 
cation code of a film cartridge containing corresponding 
photographic images. 

The invention has been described with reference to 
certain preferred embodiments thereof. It will be under- 
stood, however, that modifications and variations are 
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possible within the scope of the appended claims. For 
example, the invention has been described with refer- 
ence to an exemplary graphical user interface. It will be 
understood, however, that specifics of the user interface 
utilized to present and select camera functions can vary 
widely. In addition, modifications in the overall architec- 
ture of the camera are possible. For example, a single 
optical system can be utilized to provide scene light to 
both the CCD image sensor 94 and the image plane 
100 of the film transport unit 60. 

PARTS LIST 

1 0 main camera body 

12 sliding lens cover 

1 4 silver-halide optical system 

16 digital imaging optical system 

1 8 electronic flash unit 

19 masking device 

20 optical viewfinder 

21 optical system 

22 LCD status unit 

23 image capture mode selector switch 

24 shutter button 

25 zoom control switch 

26 picture taking mode selector switch 
28 flash mode selector switch 

30 timer mode selector switch 

32 image format selector switch 

34 hinged support element 

36 main screen display unit 

37 review switch 

38 main screen operator control unit 

39 display mode selection switch 

40 edit switch 
42 exit switch 

44 directional switch unit 

46 up directional switch 

48 right directional switch 

50 down directional switch 

52 left directional switch 

54 memory card door 

56 battery compartment door 

58 film chamber door 

60 film transport unit 

62 range finding module 

64 light sensor 

68 main camera controller 

70 analog subsystem unit 

72 digital subsystem unit 

74 camera operator interface 

76 power supply unit 

77 AA cells 

78 multi-element lens 

79 power adapter connector 

80 aperture/shutter mechanism 
82 zoom/focus mechanism 

84 multi-element lens 





86 


blur filter 




88 


telephoto drive mechanism 




90 


aperture drive mechanism 




92 


aperture 
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94 


image sensor 




96 


film drive 




98 


film chamber 




100 


image plane 




102 


winding spool 


10 


104 


f ilm perforation sensor 




106 


cartridge sensors 




107 


cartridge identification sensor 




108 


magnetic head 




110 


vertical clock drive circuit 


15 


112 


horizontal clock drive circuit 




114 


CDS circuit 




116 


programmable gain amplifier 




118 


A/D converter 




120 


microcontroller 


20 


122 


application specific integrated circuit (ASIC) 




124 


DRAM working memory 




125 


album storage section 




126 


base camera flash memory 




127 


film mode image storage section 
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128 


read only memory (ROM) 




130 


memory card interface connector 




132 


LCD interface drive circuitry 




134 


standard communications interface circuit 




136 


data communications port 


30 


140 


microcontroller 




142 


magnetics I/O 




144 


motor drivers 




150 


LCD power module 




152 


analog subsystem module 


35 


154 


main power module 




156 


LCD backlight power module 




158 


digital subsystem power module 




160 


f lash charger and control module 




162 


a flash capacitor 


40 


164 


flashtube 




200 


icon group 




202 


image display area 




204 


a scroll bar 




206 


function name display area 


45 


208 


function data entry area 




210 


copy number icon 




212 


image format icon 




214 


title icon 




216 


album icon 


50 


218 


magnification icon 




220 


mask 




222 


slide show icon 




224 


utilities icon 




226 


help icon 


55 


228 


delete icon 




232 


host computer 




233 


communications link 




234 


remote computer 
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236 monitor 

238 digital viewfinder image 
Claims 

1 . A camera comprising: 

imaging mode selecting means for selecting at 

least one of a film mode of operation and a 

hybrid mode of operation; 

digital imaging means for generating a digital 

image representative of an imaged subject 

scene in each of the film mode and hybrid 

mode; 

working memory for storing the digital image 
generated by the digital imaging means as a 
working image; 

photographic imaging means for imaging the 
subject scene onto a photographic film to gen- 
erate a photographic film image corresponding 
to the digital image in the film mode and the 
hybrid mode of operation; 
control processing means for generating a film 
mode digital image and a hybrid mode digital 
image from the working image, respectively, in 
the film mode and hybrid mode of operation, 
wherein the control processing means trans- 
fers the hybrid mode digital image to a non-vol- 
atile memory and wherein the control 
processing means transfers the film mode dig- 
ital image to an internal base camera memory 
of the camera in the film mode of operation; 
display means for selectively displaying at least 
one of the film mode digital and the hybrid 
mode digital image; 

recording means for recording data related to 
the corresponding photographic film image on 
the photographic film under control of the con- 
trol processing means; and 
identification means for generating identifica- 
tion data corresponding to the photographic 
film and the corresponding photographic film 
image and storing the identification data with at 
least one of the hybrid mode or f ilm mode of 
operation. 
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The camera as claimed in claim 1, wherein the 
identification means comprises a cartridge identifi- 
cation sensor means for reading an identification 
code encoded on the photographic film. 

The camera as claimed in claim 4, wherein the 
identification sensor means comprises a magnetic 
read head and wherein the recording means com- 
prises a magnetic write head. 

The camera as claimed in claim 5, wherein the 
magnetic read head and the magnetic write head 
are integrally formed. 

The camera as claimed in claim 1, further compris- 
ing: 

a removable memory interface connection 
means for receiving a removable memory 
device; 

wherein the non-volatile memory is 
comprised in a removable memory device; and 

wherein the control processing means 
transfers the hybrid mode digital image to the 
removable memory interface connection 
means for subsequent storage on the remova- 
ble memory device. 



2. The camera as claimed in claim 1, wherein the 
identification means comprises a camera operator 
interface for manually entering the identification 
data. so 



The camera as claimed in claim 2, wherein the 
identification means comprises a cartridge identifi- 
cation sensor means for reading an identification 
code on a film cartridge containing the photo- 
graphic film, and wherein the cartridge identification 
sensor means supplies the identification code to 
the control processing means. 
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